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© Programmable picture-outside-picture display. 



© A wide screen television apparatus comprises a 
memory (90) for storing a set of video sources (24), 
a circuit for tuning (82) to the set of video sources 
and a video signal processor (94). The video signal 
processor (94) is coupled to the memory (90) and to 
the tuning circuit (82), and develops a wide screen 
multiple picture display by selecting any one of the 
set of video sources for generating a main picture 
(22) of the display (96) and by selecting all of the set 
of video sources (24) for generating supplemental 
pictures of the display, for example as three POP's. 
A remote control (92) can be activated for choosing 
the set of video sources and for selecting the main 
picture from among the supplemental pictures. The 
multiple picture display is modified (66,68,72) in a 
manner which identifies which one of the supple- 
mental pictures (24) corresponds to the main picture 
(22). An on-screen display indicator can be gen- 
erated for the supplemental picture corresponding to 
the main picture. In an alternative, the supplemental 
picture corresponding to the main picture can be 
repositioned on the display. In another alternative, 
the supplemental picture corresponding to the main 
picture can be modified in appearance. 
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This invention relates generally to the field of 
multiple channel selection and picture display in a 
wide screen television, wherein a main video pic- 
ture and a plurality of secondary video pictures can 
be displayed as POP's, and more particularly, 
wherein the secondary pictures can represent a 
viewer selected set of available video pictures from 
which the main picture can be frequently and/or 
continuously selected and reselected by the viewer 
without having to reidentify channel numbers or the 
like. This facilitates quick and convenient monitor- 
ing of a plurality of signals such as sporting events, 
soap operas, newscasts or the like, in which the 
most interesting action of simultaneously broadcast 
programs may occur in the different programs at 
different times. 

With the advent of wide screen televisions, 
many new features are made possible. A wide 
screen television may have a format display ratio, 
for example, of 16 horizontal units and 9 vertical 
units, as opposed to the traditional television dis- 
play ratio of 4 X 3. One feature made available by 
the wide screen display ratio is the POP, or 
picture-outside-picture feature. POP involves the 
display of one or more smaller video images in an 
otherwise unused side area of the 16X9 display 
area, simultaneously with display of a larger 4X3 
image. 

The main 4X3 image, from a first source, is 
arranged to fill the available vertical space. By 
placing the main 4X3 image at one lateral side of 
the display area, sufficient space is opened along 
the opposite side for up to three more images, 
each having a 4 X 3 display ratio and being one 
third of the size of the main 4X3 image. It is also 
possible to use other specific ratios and display 
arrangements; however, by making the three small- 
er images one third of the size of the larger one, no 
cropping, uneven compression or other distortion is 
needed for any of the images contained in the first 
(main) source signal, or in the images contained in 
the signals from second through fourth sources, 
used for the pictures outside of the main picture. 
Presently available products allow either one chan- 
nel to be strobed through the three extra POP 
windows, or for the extra windows to be used to 
display images from the sequential tuning of chan- 
nels in a scan list. 

International patent application 

PCT/US91/03740, filed May 29, 1991, discloses a 
wide screen television apparatus with POP capabil- 
ities and is hereby fully incorporated by reference. 
The disclosed device has a one chip video proces- 
sor and two tuners. A wide screen processor con- 
trols the use of the display for the main picture, 
decoded using one of the tuners, and one or more 
supplemental POP's (or PIP's, i. e. picture-in-pic- 
tures), decoded using the other tuner. Where a 



plurality of supplemental pictures are provided, the 
second tuner sequentially selects one of the re- 
quired frequencies and the wide screen processor 
grabs an image. The display is then driven to 

5 present the main image and the most recently 
captured frame(s) of the supplemental image(s). 
Although the device operates continuously to up- 
date the images, due to the sharing of the second 
tuner the supplemental pictures are necessarily 

70 updated at less than their video rate. The wide 
screen processor resolves any differences in syn- 
chronization between the images. 

A system of this type, for cycling through 
channels in several small images, is also described 

is in the publication entitled The CTC 140 Picture in 
Picture (CPIP) Technical Training Manual, available 
from Thomson Consumer Electronics, Inc., In- 
dianapolis, Indiana. 

The utility of a multiple image display system 

20 could be improved if the viewer were allowed to 
control the presentation of the small images. In 
particular, it would be desirable to enable the view- 
er to select the number of small pictures and the 
source of the small pictures. If the viewer has the 

25 capability to change the number of small images, 
he or she can control the rate at which the small 
pictures are updated, as well as the resolution at 
which they are displayed. When the number of 
channels to be scanned is smaller, each can be 

30 refreshed more often using a system which suc- 
cessively cycles through the channels. If only one 
small image is used, or if two small images are 
used but one is provided from a baseband input, 
the second tuner can remain on one selected fre- 

35 quency and the sources can be switched back and 
forth using video switches. This arrangement per- 
mits very fast updating of the small images, e.g., 
up to 15 frames per second. 

Displaying a main picture and two small pic- 

40 tures, instead of the three small pictures at one 
third size as presently known, requires some crop- 
ping or squeezing to arrange the images in the 
available 16 X 9 space. However, the amount of 
cropping or the like is not great (11%), and each of 

45 the main picture and two supplemental pictures 
appears to be moving at full speed. 

It is an aspect of the invention that the selec- 
tion and display of small pictures is facilitated to 
enable the viewer to rapidly choose channels to be 

50 displayed in the small pictures, and also to select 
one of the channels for display as the main picture. 
This can be accomplished in conjunction with a 
simple input such as the up/down control button of 
a remote controller. The display is arranged visibly 

55 to indicate one of a plurality of supplemental chan- 
nels, for example using a cursor, highlighting, fram- 
ing or a similar indicator. 
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A wide screen television apparatus according 
to an inventive arrangement comprises a memory 
for storing a set of video sources, a circuit for 
tuning to the set of video sources and a video 
signal processor. The video signal processor is 
coupled to the memory and to the tuning circuit, 
and develops a wide screen multiple picture dis- 
play by selecting any one of the set of video 
sources for generating a main picture of the display 
and by selecting all of the set of video sources for 
generating supplemental pictures of the display, for 
example as three POP's. A remote control can be 
activated for choosing the set of video sources and 
for selecting the main picture from among the 
supplemental pictures. The multiple picture display 
is modified in a manner which identifies which one 
of the supplemental pictures corresponds to the 
main picture. An on-screen display indicator can be 
generated for the supplemental picture correspond- 
ing to the main picture. In an alternative, the sup- 
plemental picture corresponding to the main pic- 
ture can be repositioned on the display. In another 
alternative, the supplemental picture corresponding 
to the main picture can be modified in appearance. 
A viewer can monitor a number of programs and 
select for main viewing the most interesting pro- 
gram in a quick and convenient manner. 

The capability to display, indicate and conve- 
niently select among supplemental pictures dra- 
matically improves the usefulness of a POP or PIP 
feature in a television apparatus. If a viewer wishes 
to monitor a plurality of channels where the most 
interesting action occurs on different channels at 
different times, such as sporting events occurring 
simultaneously on three different channels, the 
viewer can program the television to display those 
channels in the smaller pictures. One of the three 
smaller pictures can always be displayed as the 
main picture and is identified visibly as the se- 
lected one in that smaller picture. Using the remote 
control, the viewer can readily switch between the 
selections to choose the main display. 

FIGURES 1 and 2 are illustrations of alternative 
picture-outside-picture display presentations on a 
16 X 9 display area, having a main picture and 
three smaller pictures. 

FIGURE 3 shows a POP display arrangement 
according to the invention, wherein the main pic- 
ture is selected from one of three POP's, and is 
indicated on the corresponding POP. 

FIGURE 4 is a flow chart showing processing 
steps for selection and display of a selected chan- 
nel. 

FIGURES 5 through 7 show exemplary POP 
indicating formats according to the invention. 

FIGURE 8 is a schematic block diagram show- 
ing the functional elements of the invention. 
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Referring to FIGURE 1, a 16 X 9 wide screen 
display format 20 is shown wherein one large 4X3 
format display ratio picture 22 and three smaller 4 
X 3 format display ratio pictures 24 are displayed 

5 simultaneously. The wide screen can be part of a 
direct view or projection television apparatus. A 
smaller picture outside the perimeter of the large 
picture is referred to as a POP, that is, a picture- 
outside-picture, as opposed to a PIP, a picture-in- 

10 picture. In those circumstances where the wide 
screen television is provided with two tuners, either 
both internal or one internal and one external, for 
example in a video cassette recorder, two of the 
displayed pictures can display movement in real 

T5 time in accordance with the source. The remaining 
pictures can be displayed in freeze frame format or 
the like. It will be appreciated that the addition of 
further tuners and additional auxiliary signal pro- 
cessing paths can provide for more than two mov- 

20 ing pictures. It will also be appreciated that the 
large picture 22 on the one hand, and the three 
small pictures 24 on the other hand, can be 
switched in position, as shown in FIGURE 2. 

A presentation as shown in FIGURES 1 and 2 

25 can be produced, for example, according to the 
disclosure of international application 
PCT/US91/03740, filed May 29, 1991, which is 
hereby fully incorporated. In that device, two tuners 
and two processors manage the capture and stor- 

30 age of pixel data which is arranged in the desired 
display format and read out via a CRT or other 
display. A signal processor generates first and sec- 
ond video signals from input video signals and a 
switching circuit selectively couples video signal 

35 sources as the input video signals. The signal 
processor can manipulate data from the input video 
signals by selective interpolation and cropping. A 
synchronizing circuit synchronizes the first and 
second signal processors with a mapping circuit 

40 and a selecting circuit selects as an output video 
signal one of the first and second processed video 
signals and combinations of the first and second 
processed video signals. 

For simultaneous display of a plurality of pic- 

45 tures wherein at least one of the pictures is up- 
dated at full speed, at least two tuners are used. 
One tuner is devoted to the main signal and the 
other tuner is sequentially tuned to the supplemen- 
tal channels, in turn grabbing a frame from each of 

50 the supplemental channels which are selected by 
the viewer. It would also be possible to use addi- 
tional tuners so that the supplemental channels 
could be updated at full speed. 

In FIGURE 3, the main and supplemental chan- 

55 nels are displayed simultaneously, with the main 
picture 22 corresponding to one of the POP areas 
24. The viewer enters a list of channel selections, 
for example using a remote controller in response 
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to on-screen menu prompts, then selects which of 
the selections in the list is to be displayed as the 
main channel. Alternatively, the menu prompts may 
enable the selection of channel numbers from a 
scrollable list indicated, for example, by highlight- 
ing. As a further alternative, a plurality of channels, 
for example twelve, may be shown in freeze frame 
in a channel guide display. The viewer can then 
select POP sources by manipulating an on-screen 
selector, in a manner similar to those described in 
detail below in connection with FIGURES 3-7 and 
procedures for choosing a main picture from the 
available POP's. The viewer's selection for the 
main channel is visibly indicated in the POP area 
25 corresponding to the main channel. The viewer 
can also control the number of POP's to be dis- 
played, according to the number of channels se- 
lected. 

In FIGURE 3, the channel numbers 32 are 
shown and the selected one of the channels from 
the list for use as the main channel is identified by 
an extra mark character 34, which in the illustrated 
example defines a pointer ">". There are a number 
of alternatives for showing the channel numbers 
and for identifying the selected channel. In this 
case, the on-screen character generator of the tele- 
vision is arranged simply to add the marking char- 
acter to the displayed channel number. The chan- 
nel numbers 32 for the main and/or supplemental 
channels can remain on, can be switchable be- 
tween momentary-display and persistent modes, or 
can be displayed briefly in the event of a channel 
change, change of selected channel, operation of 
the remote for any reason, etc. 

The channel selection and frame grabbing as- 
pects of the television can operate in a cyclic loop 
as shown in FIGURE 4. Before storing a next frame 
of information for the main and supplemental chan- 
nels, a decision branch 42 is encountered based 
on whether new data has been received from the 
remote control. In the event of viewer input from 
the remote control, new channel selections are 
entered into the channel list at block 44, or a 
different one of the listed channels is selected for 
viewing as the main channel at block 46. The 
viewer input can be a number from a keypad on 
the remote, for setting the channels or selected 
channel. However, the display feature of the inven- 
tion is most easily used when the channel selection 
is embodied as a simple one or two button viewer 
input such as the up/down control on the remote 
control allow the viewer to switch from one of the 
supplemental channels in the list to the next, with 
one stroke. Up/down controls (e. g., +/-, A/V) on 
remote control devices are marked with a variety of 
symbols and are sometimes separate switches and 
sometimes rocker switches. 



The channel selection list is used to determine 
the frequencies on which the tuner(s) are to be 
locked. Typically the tuner includes a phase locked 
loop that is locked to a frequency defined by a 

5 digital signal from the control processor, e.g., a one 
chip processor. The main channel frequency can 
be set at one of two tuners and the supplemental 
channel frequencies can be sequentially set at a 
second tuner, which locks to the supplemental 

10 channels one at a time. As a result, the refresh rate 
of the supplemental channels is less than their 
frame rates. Whereas the main channel is obtained 
from one tuner, the second tuner need only cycle 
through the other channels in the channel list. 

is The main channel frame is stored at block 48 
in FIGURE 4, and the two remaining channels in 
the list are stored at blocks 52 and 54. FIGURE 4 
shows the frame storage blocks as sequential oper- 
ations; however, the timing is such that the main 

20 channel is processed more or less in parallel with 
the remaining channels in the list. 

Having obtained stored frames for the three 
channels, the display is generated at block 56, and 
the cycling continues. Generation of the display 

25 can involve reading pixel data from RAM, and 
converting the pixel data into RGB or YUV analog 
signals at the horizontal scanning rate of the dis- 
play. Whereas the main signal is read out full size 
in main window, and the main and supplemental 

30 channels are read out at one third size for the side 
windows, the channel data for those channels 
which are not selected as the main channel can be 
stored using a lower pixel resolution than for the 
main channel. Alternatively, the pixel resolution can 

35 be the same as stored, but the data for channels 
other than the main channel (as well as the small 
version of the main channel appearing in side win- 
dow) can be sampled, interpolated, cropped or 
otherwise compressed for display in the proper 

40 size and position on the screen. 

A visible indication of which of the smaller 
pictures has been selected as the main channel is 
preferred, together with a simple up/down control 
switch for changing the selected main channel from 

45 one of the channels in the list to the next. These 
two features enable the viewer to switch readily 
between the channels whenever the most interest- 
ing action appears in a channel other than the main 
channel, effectively monitoring all three channels at 

50 once. This feature is especially useful for fans of 
sporting events, soap operas and newscasts, for 
example, since it is frequently the case that two or 
more such events are televised at the same time. 
In FIGURE 4, the selected channel 25 is visibly 

55 distinguished from the other channels by an extra 
border line 62 in the small image. 

FIGURES 5-7 illustrate other methods for pro- 
viding a visible indication of the selected channel 
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25. In FIGURE 5, on-screen indicators 32 are pro- 
vided to identify the channel number of the main 
screen 22, and each of the smaller screens 24. To 
distinguish the selected smaller screen 25 from the 
others, the image 66 displayed on the selected 
smaller screen is altered, for example in luminance, 
saturation and/or hue, so as to readily identified. 
For example, the selected channel can be darker 
than the corresponding image on the main screen, 
or if desired, blanked entirely. 

In FIGURE 3, the on-screen characters 32 
identifying the channel were supplemented by a 
marking character 34 to show the selected channel 
25. The marking character can be used alone (i.e., 
without a channel number) or the persistence of the 
channel number on the selected small screen can 
be different than that for others. As shown in FIG- 
URE 6, if only the selected screen has an on- 
screen channel number, the selected channel is 
clearly identified. As also illustrated in FIGURE 6, 
the form of the on-screen channel number can 
identify the selected channel. For example, the on- 
screen character 68 can by larger or of a distinct 
font or shape, and/or the color or brightness of the 
on-screen character can be distinct from the other 
channels. In FIGURE 6 the non-selected channels 
can also display channel numbers, for example for 
a few seconds following a change in the channel 
selection list or a change in the selection of the 
main channel from the list. 

In FIGURE 7, the selected channel 25 is iden- 
tified by a distinct border design 72. For example, 
a darker or lighter border, a colored border or a 
thicker border can distinguish the selected channel 
from the others. As another possibility, the place- 
ment of the supplemental channels can be made to 
indicate the selected one. For example, the se- 
lected main channel can be displayed always in 
the center smaller block as in FIGURE 7, and when 
a different main channel is selected (e.g., by use of 
an up or down signal from the remote control), the 
supplemental channels can be rearranged in posi- 
tion such that the new selected channel appears in 
the middle and the former selected channel is 
moved to the top or bottom, etc. 

It will be appreciated that there are various 
additional ways in which the selected channel can 
be visibly distinguished, and the foregoing particu- 
lar examples are not intended to limit the invention 
to particular forms for visibly distinguishing the 
selected channel from the others. 

FIGURE 8 is a schematic diagram illustrating 
one possible arrangement for signal flow between 
the functional elements of the invention. The group- 
ing of the functions into specific blocks does not 
exclude the possibility that these functions will be 
contained in the same circuits or processors. In 
FIGURE 8, a channel selection circuit 82 is coupled 



to a plurality of video sources, for example fre- 
quency division multiplexed signals received over 
the air on an antenna 84. Under control of the 
channel selection circuit, one or more tuners 86 

5 extracts one or more of the channel signals. The 
available channels may come from diverse other 
sources as well. For example, a baseband signal 
may be available from a VCR 88 or the like, and 
also be available to the channel selection circuit 82. 

70 In any event, at least two signals are derived from 
the available inputs, and preferably three, the chan- 
nel selection circuit 82 being operable to select 
from the plurality of video sources at least one 
main channel and at least one supplemental chan- 

75 nel. 

The video data from the signals is stored in a 
frame storage means 90. The channel selector 82 
is also coupled to a viewer input 92 for changing 
which of the plurality of video sources will be the 

20 main channel, and which will be displayed on the 
smaller POP windows only. The viewer input de- 
vice can be a remote control having up/down 
switches 93, and can also be used to add, remove 
or change channel numbers in a stored list of 

25 channels which are to be captured by the channel 
selection circuit 82. 

The stored video frame data is passed to a 
video decoding and driving means 94 coupled to 
the channel selector 82 and to a wide screen 

30 display 96. The video decoding and driving means 
94 is operable to present the selected main chan- 
nel and supplemental channel substantially simulta- 
neously on the display 96, at different areas and 
normally in a manner that displays the main chan- 

35 nel 22 substantially completely and full size. The 
supplemental channels 24 can be smaller, and can 
be updated less frequently than the full video rate 
which is available from the respective source. 
An indicator generator 98 is coupled to the 

40 channel selector 82 and to the video decoding and 
driving means 94. The indicator generator 98 is 
operable to produce a visible indication 34, 62 on 
the display for identifying at least one of the se- 
lected main channel and supplemental channel 

45 from a plurality of potential selections available 
from the channel selector 82. In the embodiments 
described above, all the available channels from a 
list of three channels are displayed on the smaller 
POP's, and the main channel is displayed redun- 

50 dantly in the larger main display area. 

The indicator generator 82 is operable to iden- 
tify a selected one of the supplemental channels 
for display as the main channel by use of a distinct 
on-screen presentation of the respective image 24 

55 or its channel number 32. The channel number 
may be distinct as to presentation, persistent or 
momentary presentation, shape, size, font, addi- 
tional cursor marker or the like. The image itself 
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may be presented distinctly, for example using an 
identifiable frame element and/or a variation of one 
or more of luminance, saturation and hue, for dis- 
tinguishing the main channel from among the sup- 
plemental channels in the smaller POP windows 
24. 

The invention is particularly applicable to a 
wide screen display with at least three POP's dis- 
played laterally to one side of the main picture. For 
example, the display can be a 16 X 9 format 
display ratio with the main and supplemental chan- 
nels arranged for a 4 X 3 format picture. The main 
channel fills the screen vertically, and three one- 
third size supplemental channel POP's are dis- 
played at a lateral side of the display. 

Claims 

1. A television apparatus, comprising: 

means for storing (90) a set of video sour- 
ces (24); characterized by 

means for tuning (86) to said set of video 
sources; 

video signal processing means (94) for de- 
veloping a multiple picture display, coupled to 
said storing means (90) and to said tuning 
means (86), by selecting any one of said set of 
video sources for generating a main picture 
(22) of said display (20) and by selecting all of 
said set of video sources for generating sup- 
plemental pictures of said display, smaller in 
size than said main picture; and, 

control means (82) responsive to viewer 
activation for choosing said set of video sour- 
ces (24) and for selecting said main picture 
(22) from among said supplemental pictures. 

2. The television apparatus of claim 1 , character- 
ized by means for modifying said multiple pic- 
ture display in a manner which identifies which 
one of said supplemental pictures corresponds 
to said main picture. 

3. The television apparatus according to claim 1 , 
characterized by said multiple picture display 
comprises three of said supplemental pictures, 
disposed laterally to one side of said main 
picture. 

4. The television apparatus according to claim 1 , 
characterized in that said multiple picture dis- 
play is a wide screen display and comprises 
three of said supplemental pictures. 

5. The television apparatus according to claim 1 , 
characterized in that said multiple picture dis- 
play has a 16 X 9 format display ratio and said 
main picture and each of said supplemental 



pictures has a 4 X 3 format display ratio. 

6. The television apparatus according to claim 2, 
characterized in that said multiple picture dis- 
5 play modifying means comprises means for 

generating an on-screen display associated 
with said one of said supplemental pictures 
corresponding to said main picture. 

to 7. The television apparatus according to claim 6, 
characterized in that said on-screen display is 
persistent. 

8. The television apparatus according to claim 6, 
15 characterized in that said on-screen display is 

a channel indicator (68). 

9. The television apparatus according to claim 6, 
characterized in that said on-screen display is 

20 a cursor (66). 

10. The television apparatus according to claim 6, 
characterized in that said on-screen display is 
picture frame (72). 

25 

11. The television apparatus according to claim 2, 
characterized in that said multiple picture dis- 
play modifying means comprises means for 
changing in position on said display said one 

30 of said supplemental pictures (24) correspond- 
ing to said main picture (22). 

12. The television apparatus according to claim 1, 
characterized in that said multiple picture dis- 

35 play modifying means modifies said supple- 
mental picture corresponding to said main pic- 
ture by one of luminance, saturation and hue. 

13. The television apparatus according to claim 1, 
40 characterized in that said control means (82) 

comprises a remote control device (92), having 
at least one UP/DOWN switch means for se- 
lecting said main picture. 

45 14. The television apparatus of claim 1, character- 
ized in that said main picture and one of said 
supplemental pictures are generated from the 
same video source. 

50 15. A television apparatus, comprising: 

means for storing a set of video sources 
(90); characterized by 

means for tuning to said set of video sour- 
ces (86); 

55 video signal processing means (94), coup- 

led to said storing means (90) and to said 
tuning means (86), for developing a multiple 
picture display on a video display means (96) 
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having a wide format display ratio by selecting 
any one of said set of video sources (24) for 

generating a main picture (22) of said display [ 
and by selecting all of said set of video sour- 
ces for generating supplemental pictures of 5 j 
said display, smaller in size than said main 
picture; 

control means (82) responsive to viewer 
activation for choosing said set of video sour- 
ces and for selecting said main picture from jo 
among said supplemental pictures; and, 

means for modifying (98) said multiple pic- 
ture display (96) in a manner which identifies 
which one of said supplemental pictures cor- 
responds to said main picture. 15 \ 

| 
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